0} 

fs 


KARROW’BA^O  SYSTEMS  AfiD  SA'JSSIAHITY 
Polytechnic  Institute  of  Brooklyn 


Approved  lor  p«MXr.  re  less-;; 
dictribntioa  an.li«ifcCc2, 


DI  -62“  "5 1 


NATIONAL  TEC 
INFORMATION 


HN’ICAL 

SERVICE 


Rcrr.o  A;r  Development  Center 
Air  Force  Systems  Command 
Griffiss  Air  Fcrco  Base,  New  York 


REPORT  SECURITY  CLASSIFICATION 


Security  Classification 


DOCUMENT  CONTROL  DATA  -  R  &  D 

(Security  classification  of  title,  body  of  abstract  and  indexing  annotation  must  be  entered  *hen  the  overall  report  is  clasellied) 


i  originating  activity  (Corporal*  author) 

Polytechnic  Institute  of  Brooklyn 

Long  Island  Graduate  Center  2h  croup 

Route  110,  Farmingdale,  NY  1173c  N/A 


3  REPORT  TITLE 


4  OESCRIP'I  VC  NOTES  (Type  of  report  and  inclusive  dates) 

Technical  Report 


S  AUTHORISE  (Fir*1  name,  middle  initial,  la *t  name) 

A.  Papoulis 


«  REPORT  OATC 

November  1971 


Ba.  CONTRACT  OR  GRANT  NO. 

F30602-69-C-0331 
Job  Order  No.  01720000 
DI-69-H 


tO  DISTRIBUTION  STATEMENT 


7a.  TOTAL  NO.  OF  PAGES  176.  NO  OF  REFS 


7a.  ORIGINATOR'S  REPORT  NUMBER(S) 


9b.  OTHER  REPORT  NO(S)  (Any  other  number*  that  may  ba  aaalgnad 
thla  report) 


RADC-TR-71-225 


Approved  for  public  release;  distribution  unlimited. 


12  SPONSORING  MILITARY  ACTI  VlTY 


Rone  Air  Development  Center  (ISCP) 
Griff iss  Air  Force  Base,  New  York  I3M0 


13  ABSTRACT 


The  approach  to  Gaussianity  of  the  output  y(t)  of  a  narrowband  system  h(t)  is 

investigated.  It  is  assumed  that  the  input  x(t}  is  an  a-dependent  process  in  the 

sense  that  the  random  variables  x(t )  and  x(t+u)  are  independent  for  u  >  a.  With 

F(y)  and  0(y)  the  distribution  function  of  y(t)  and  of  a  suitable  normal  process,  a 

realistic  bound  B  of  the  difference  F(y)  -  G(y)  is  determined  and  it  is  shown  that 

B*0  aa  the  bandwidth  u  of  the  system  tends  to  zero. 

o 


,1473 


UNCLASSIFIED _ 

Security  Classification 


When  US  Government  drawings,  specifications,  or  other  dua  are  used  for  any  purpose  other 
than  a  definitely  related  government  procurement  operation,  die  government  thereby  incuts 
no  responsibility  nor  any  obligation  whatsoever;  and  the  fact  that  Jie  government  may.  have 
formulated,  furnished,  or  in  any  way  supplied  the  said  drawings,  specifications,  or  other 
data  is  not  to  be  regarded,  by  implication  or  otherwise,  as  in  any  manner  licensing  die 
holder  or  any  other  person  or  corporation,  or  conveying  any  rights  or  permission  to  manu¬ 
facture,  use,  or  sell  any  patented  invention  that  may  in  any  way  be  relaced  thereto. 


Do  not  return  this  copy.  Retain  or  destroy. 


KEY  wo  R  03 


Narrow  Band  Systems 
Gaussianity 
Random  Processes 


UNCLASSIFIED 

Security  Claasificat 


TABLE  OF  CONTENTS 


Section  Page 

Abstract  .  1 

1.  Introduction  .  . .  1 

2.  The  Berry-Esseen  Theorem . 3 

3.  Systems  Driven  By  An  Impulse  Train  7 

4.  Shot  Noise  . . g 

5.  Band-Limited  Systems  With  a-Dependent  Inputs  .  11 

Appendix  A . . . . 

Appendix  B . 21 

Appendix  C . 23 

Appendix  D . 25 

References  .  . . 28 


iii 


NARROW-BAND  SYSTEMS  AND  GAUSS I AMITY 
A.  Papoulis 

Polytechnic  Institute  of  Brooklyn 


Approved  for  public  release; 
distribution  uniinited. 


DI-69-11 


FOREWORD 


This  Phase  Report  was  submitted  by  Polytechnic  Institute  of  Brooklyn, 
Long  Island  Graduate  Center,  Route  110,  Faraingdale,  New  York,  under 
Contract  F30602-69-C-0331,  Job  Order  Number  01720000,  with  Rome  Air  Devel¬ 
opment  Center,  Griffiss  Air  Force  Base,  New  York.  Haywood  E.  Webb,  Jr., 
was  the  RADC  Project  Engineer. 

Research  results  reported  herein  were  funded  by  the  Laboratory 
Director' 8  Fund,  DI-69-11. 

This  report  has  been  reviewed  by  the  Information  Office,  01,  and 
is  releasable  to  the  National  Technical  Information  Service,  NTIS. 

This  technical  report  has  been  reviewed  and  is  approved. 


Approved: 


Project  Engineer 


hu 

Approved:  DANIEL  R.  ifORETO ,  Chief 

Computer  Technology  branch 
Information  Sciences  Division 


ii 


ABSTRACT 

The  approach  to  Gaxissianity  of  the  output  y(t)  of  a  narrow- band 
system  h(t)  is  investigated.  It  is  assumed  that  the  input  x  (t)  is  an 
a-dependent  process  in  the  sense  that  the  random  variables  x(t)  and  x(t+u) 
are  independent  for  u  >  a  .  With  F(y)  and  G(y)  the  distribution  function 
of  y(t)  and  of  a  suitable  normal  process,  a  realistic  bound  B  of  the  differ¬ 
ence  F(y)  -  G(v)  is  determined  and  it  is  shown  that  B  -*  0  as  the  band¬ 
width  uuq  of  the  system  tends  to  zero.  In  the  special  case  of  the  shot  noise 
process 

y(t)  =  Y 

i 

it  is  shown  that 


|  F(y)  -  G{y) 


where  \  is  the  average  density  of  the  Poisson  points 


1.  Introduction  INTRODUCTION 

In  the  engineering  applications  of  random  signals  it  is  often 
assumed  that  if  a  stationary  process  x(t)  is  the  input  to  a  linear  system, 
then  the  resulting  response 

00 

x  (t)  =  J  X  {t-a)  h(a)  d  a  (1) 

•  00  ~ 

‘ends  to  a  normal  process  as  the  bandwidth  u)0  of  the  system  tends  to  zero. 
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( 


This  theorem  is  not  always  true  as  one  can  show  with  a  trivial  counter 
example.  However,  it  holds  under  fairly  general  conditions.  To  apply  it 
meaningfully,  we  need  to  establish  not  only  conditions  for  its  asymptotic 
validity,  but  also  realistic  bounds  for  the  deviation  of  jr(t)  from  Gaussianity 
for  a  given  ouq  0  . 

As  one  might  expect  from  the  central  limit  theorem,  y(t)  will 
approach  Gaussianity  if  the  past  x  (u),  u  <  t  of  the  process  x  (t)  is  "almost" 
independent  of  its  future  x  (u),  u  >  t  +  T  for  sufficiently  large  T  .  This 
loose  requirement  is  precisely  formulated  in  Rosenblatt's  classic  paper  [1] 
as  follows: 

Let  b  and  F  be  the  Borel  fields  generated  by  the  random 
variables  x  (u)  f*_r  u<t  and  u>t  +  T  respectively.  We  say  that  the 
process  x(t)  satisfies  the  strong  mixing  condition  if  there  is  a  function 
g  (a)  with 

0<  g(a)  |0  as  a  -  ®  (2) 

such  that  for  any  pair  of  events  B  e  B^,  F  e 

1  P(BF)  -  P(B)  P(F)  1  <g(T)  (3) 

Assuming  further  that  the  moments  of  x  (t)  of  order  up  to  four  exist  and 
satisfy  certain  conditions  and  that  its  power  spectrum  S(UJ)  is  such  that 

S(u>)  >  0  (4) 

he  shows  that  the  output  y(t)  of  a  certain  class  of  filters  tends  to 
Gaussianity. 

In  applying  Rosenblatt's  result,  we  are  faced  with  the  problem  of 
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testing  the  mixing  condition  (3).  Furthermore,  the  problem  of  establishing 
realistic  bounds  for  the  distance  of  y{t)  from  Gaussianity  remains.  In  this 
paper  we  shall  overcome  these  difficulties  but  only  at  the  sacrifice  of  gener¬ 
ality.  We  shall  base  our  analysis  on  the  assumption  that  the  process  x  (t) 
is  a-dependent,  i.  e. ,  that  the  events  B  and  F  are  independent  for  T  > a  . 
This  assumption  is  equivalent  to  the  condition 

g(a)  =  0  for  a>a  (5) 

The  above  is,  of  course,  more  restrictive  than  (2),  however,  it  holds  in 
many  applications  and  can  be  often  readily  established.  Suppose,  for 
example,  that  x  (t)  is  the  output  of  a  memory-less  non-linear  system  with 
input  a  norir  al  process  s  (t).  In  this  case,  condition  (5)  is  equivalent  to  the 
a ssumption  that  the  autocovariance  C{t)  of  s(t)  vanishes  for  T>a. 

2.  The  Berry- Es seen  Theorem 

The  output  y(t)  of  our  system  is  a  linear  combination  of  a  non- 
countable  infinity  of  dependent  random  variables.  As  we  show  in  section  5, 
if  the  input  x(t)  is  a-dependent,  then  the  principal  part  of  y(t)  can  be 
expressed  as  a  sum  of  independent  random  variables.  To  solve  our  problem 
we  shall  need,  therefore,  a  bound  of  the  deviation  of  such  a  sum  from 
Gaussianity.  Such  a  bound  is  given  in  the  following  important  theorem  due 
to  A.  C.  Berry  and  G.  Esseen  [2,  3].  We  present  it  here  for  easy  reference 
and  also  because  in  the  proof  we  make  use  of  a  useful  lemma  (Appendix  A) 
which  is  an  improvement  of  the  corresponding  lemma  1  in  Feller  [2,  p.  510]. 
Wiuh  its  help,  we  obtain  the  constant  4  in  (8),  whereas,  the  corresponding 
constant  in  Feller  is  33/4.  However,  as  it  is  stated  in  [2],  unpublished 
calculations  mention  the  constant  2.  9  (Esseen,  1956)  and  2.  05  (Wallace,1958). 

Consider  a  sequence  x^,  x^,  •••  of  independent  r.v.  (random 
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variables)  such  that 


E  IX.J  =  0  , 
We  form  the  sum 


X  =  — -  /  X  . 
~  0  A  ~  1 


f  2-.  -  2  _  r  i  i3t 

l  Xf  1=0^.  n,  t  I x .  i  j  =  c. 


2  V  2 

where  C  =  /  o 


<  05 


(6) 


2 

Clearly,  E  {x  }  =  1  .  With  P(x)  the  distribution  function  of  x  and 

2/ 

-y  h 


G(x)  =  J  e_y72  dy 
y2rr 


(7) 


that  of  a  normal  r.  v.  with  the  same  mean  and  variance,  we  wish  to  bound 
the  "distance"  l  F(x)  -  G(x)  |  of  x  from  Gaussianity. 

Theorem.  If 


c. 

l 


0. 

l 


2  - 


<  X 


then 


1  F(x)  -  G(x)  J  <  4*- 


(8) 


Proof.  With  and  ?(uu)  the  characteristic  functions  of  the  r.  v.  x.  and 


x  respectively,  we  conclude  from  (6)  and  the  independence  of  the  x.  s  that 


~  i 


*W  *i(!)-  •*© 


(9) 


As  we  see  from  (B-6) 


2  2 
O.  U) 

1 


8.(u>)  =  e 


2  +  ®i  21  ^  ^ 


UI<2T<^ 


2X  -  2  c. 

i 


(10) 


{throughout  the  paper  the  letter  9  will  always  be  such  that  }<  1  ), 
hence. 
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r 


B  ' 


SSUHW1MP4! 


-^+e  5  lai3  ?c. 

*(UI)  =  e  2  °  21  O3  1  1  =  e 


+  e  #t;  M" 


2  21  a  •  -  *  |..t  -_C_ 

2X 


because 


r  c. 

1  c. 

— - ~  <  Max  — y  <  X 

To.  0 . 

l  i 


But  for  any  z 


.  lwi; 


(11) 


z  1 
e  -1 

I 

z 

i 

z 

2 


|!+...[<  i+u|+i|L+. 


=  e 


I  A 


hence. 


$  (ui)  -  e 


U) 

2 


<  e 


U) 

z 


5  8  X  Juuj^  ! 

21  a  -1  < 


•  IS  fx 


5X 

210 


M 


3  2 

e 


, 

■  1 


•*ras^|-|] 


U) 


210 


<m\”  \ 


(12) 


a3) 


We  now  introduce  a  function  r(x)  as  in  (A-l)  with  Fourier  trans¬ 
form  R(id)  such  that 


R(iu)  =  0  for  |uu  |  >  iDj  = 

As  we  see  from  (A-l) 

i  R{iD)  |  <  R(0)  =  1 
The  transform  of  the  convolution 

g(x)  =  [  F(x)  -  G(x)  ]  *  r(x) 


(14) 


(15) 


(16) 
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£ 


is  given  by  [4] 


3(u))  -  e 


-  U)2/2 


hence. 


J  «» 


I 


R(«s) 


$(U))-e 


n  |8<X)I  j.J^  ■ 


-u)2/2 


R<“»  <H  <  3* 


id. 


J  «2e-“Z/4du. 


-  U>, 


00 

,  5X  f-  2  -0)2/4  ,  5X  ,  7±- 

W.J  “  6  dU1  =  2To-.'4VTT 


Thus 


.  I  g(x)  |  f 


10  X 
2l0i/tT* 


Since 


,  1  -xZ/2  ,  1 

G  (x)  =  . e  <  — — 

'  JTii  '  /Zrt 

we  conclude  from  (17)  and  (A-15)  that  1 

|  F(x)  -  G(x)  |  <  Y^lr  • 
where  the  constant  Y.  is  such  that 

J  r(x)dx  =  }+|^ 

0 

We  now  choose  for  r(x)  the  Fejer  kernel  [4] 


r(x)  = 


sin2(<JUjX/2) 
tt  yjj  x2/2 


whose  transform  is  a  triangle  satisfying  (14).  And  with 


(17) 


(18) 


(19) 


(20) 


i 


1 


•V  OV 
w  =  ~2  l4T 


we  conclude  that 


i  F(x)  -  G(x)  |  w 


where  w  is  such  that 


1  r  sin2x  j  1  ,  5 

—  — 5 dx  =  -=■  + - 

""  *2  3  126/2  w 


Solving  we  find 


w  st  1.  26 


Inserting  into  (22)  we  obtain  (8). 

Corollary.  If  the  r.  v.  z^  are  independent  with 

E{z.}=0  ,  E{z.2}=02,  E{|z.|3}<c 


z  =  S  a.  z.  ,  ia.|<  A  ,  I  a.2  =  a2 


F(z)  -  G 


Ci.)  < 

\ao/  - 


The  above  follows  from  (8)  with  x.  =  a.  z.  . 

~  l  i~i 

3.  Systems  driven  by  m  impulse  train 

Consider  a  band- limited  system  with  energy  E 


E  =  J  h2(t)  dt 


H(tl>)  =  0  for  |  (l)  |  >  a) 


? 


As  it  is  known  [  5]  , 


Eu) 


'  ■c'  r1  o 

lh(t)|  l  hZ(t-nT) 


n=  -<® 


I  £°r  T<f 

o 


(27) 


With  zn  a  sequence  of  r.  v.  as  in  (24)  we  form  the  impulse  train 

? (t)  =  Z  £n  6  (t_nT)  T  <  dr  (28) 

o 


m 


If  x(t)  is  the  input  to  our  system,  then  the  resulting  output  is  given  by 


y(t)  =  Y  z n  h(t-nT) 
n 


(29) 


Clearly, 


K  {y(t)=0  ,  E  (y2(t)  3  =  0y2  = 

With  F(y)  the  distribution  function  of  y(t),  it  follows  from  (25)  and  (27) 
that 


F(y)-c(i)<i§ 
y  a'1 


(30) 


From  the  above  it  follows  that  v(t)  tends  to  Gaussianity  with  u)q  -  0  . 

4.  Shot  noise 

Consider  the  random  points  t^  of  a  Poisson  process  with  average 
density  X  .  If  the  sequence  of  impulses 


6(t-tn) 


(31) 


n 


is  the  input  to  our  system,  then  the  resulting  output 
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where 


J  U(t)|; 


dt 


9  = 


fxi  -3 


■-iJS 


6V  X  E' 

because  [see  (27)] 


j  |h(t)|3  dt 


-  CC 

Em  » 

■Vs/ 


li  (t)  dt  =  E 


Em 


V  TT 


(40) 


(41) 


From  (39)  and  (12)  we  obtain 

a)2  i  3 
08u) 


$  (uj) 


-u>2/2 
-  e 


e  -1 


<  B  |u)| 


3  2 


8  |u)| 


(42) 


valid  for  all  uu .  With  €  <  1  a  constant  to  be  soon  determined,  we  observe 
that 


*X+  9  l‘«|3<-J4'  for  1  ^  1  <  2F  - 1- )  -  “i  (43) 

hence, 

•i 

|  f  (id)  -  e"1"  ^2|  <  0  |u)|3  e  26  ,  |(i)  j<  (Dj  (44) 


We  now  proceed  as  in  section  2:  with  r(x)  and  g(x)  as  in  (16),  we 


have 


2  tt  |  g(x)|  = 


<D, 


I 


id. 


$((!)) 


-id2/2 


DU. 


(U 


R(w)  duu 


<  0  J 


2  -ID 
U)  e 


2/2-2 


e  diD<8e2vf2TT 


-<D, 


Therefore,  [  see  (17)  to  (23)] 


(45) 
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that 


max 

r 


+  a 


min 

S 


t 

s 


then  the  r.v.  x(tf)  and  x(tg)  are  independent.  Hence, 

a 

R(r )  =  C  for  [  t  |  >  a  ,  S(0)  =  J  R(t)  dT 

-a 


We  define  the  constant  Ct  by 


(*50) 


a 


-a 


R(T)dT=  as(0) 


(51) 


It  is  easy  to  see  that  a  <  1  . 

In  this  section  we  shall  bound  the  deviation  of  the  output  y(t)  of  our 
system  (26)  in  terms  of  the  above  quantities  and  the  third  absolute  moment 


E  £  |  x  (t)  l3  }  =  c  (52) 

of  the  input  x(t). 

For  this  purpose,  we  express  the  impulse  response  h(t)  of  our 
system  as  a  sum  (Fig.  1) 


h(t)  =  h  (t)  +  e  (t) 
of  a  staircase  function 


h(t)=h(nT)  (n-|)T<t<(n+-|)T 
and  an  error  term  e(t)  ,  where  T  is  such  that 

2  a  <  T  <  —  T  =  a  +  b 

o 


(53) 


(54) 


(55) 
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We  next  form  the  r.v. 


(n  -  \  )  T  +  B 


z 

~  n 


I  -f 


(t-a)  da  w, 


<“-i> r 


(n  +  j  )  T 

n  =  J  x(t-a)  da 

(n  -  |  )  T  +  b 


and 


1  h(nT;2„ 


w=  £  h(nT)  wn 


n 


n 


As  v/e  see  from  (53),  the  output  y(t)  of  the  system  is  given  by 
00 

y  (t)  =  J  h  (a)  x  (t-  a)  da+  e 


where 


e  =  J  e  (a)  x  (t-  a)  d  a 


(56) 


(57) 


(58) 


(59) 


From  the  above  it  follows  that 


y  (t)  =  z+  w  f  e  (60) 

As  we  shall  presently  see,  if 

a  <<T  <<  tt/uuo  (61) 

then  the  dominant  term  in  (60)  is  the  r.v.  z  . 

From  (56)  and  (57)  and  the  stationarity  of  x(t)  it  follows  that 
[  9  p.  346  ] 
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—  f  “) 

*  ,-  ~  n ( 


TT*  f 1  _  A 

x*  l  W^J  -  yj 


E  {  z  2} 
~n 


a 

b  j  R(t)  f  1  -  ^ ]  dt  =  S(0)  (1  -  a|)  b 


a 

E  {wn23  =aj  R{t )  fl  -  ilbdT  =  S(0)  (1  -  a) 


b  b  b 


e  t uni3}  <  JJJeu  x(a2)  x(a3)  jldc^do^da. 


0  0  0 


C  |  xy  z  J  <  E  [  |x  |3}  E  {  |y  \5}  E  {  |z|^3 


as  one  can  show  from  Holder's  inequality,  hence,  [  see  (52)] 


E  {  |  zj3  }  <  b3  c 


From  the  a- dependence  of  x  (t)  it  follows  that  the  r.  v.  z^  are  independent, 
hence,  [  see  (27)] 


52  =  E  {  z2}  =  7  h2  (nT)  E  {  zn2}  =  |  S(0)  a  -  )  b 


j  vu 

But  |  h(nT)  |  <  ^ ,  therefore,  [see  (25)  and  (68)] 


F(z)  -  G 


(f)h 

7 


\  T  Vi 


where 
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(69) 


The  r.  v.  wn  are  also  independent,  hence. 


E  [  (w  +  e)2  }  <  (Ow  +  ae)2  =  E(A2  +  A3)2  (74) 

The  constant  T  is  still  to  be  determined.  If  it  is  small,  then 
the  bound  in  (68)  is  small,  however,  the  variance  of  the  term  w+  e  is 
large.  To  account  for  its  effect  on  the  distribution  F^(y)  of  y(t)  [see  (62)] 
we  shall  use  the  bound  ^-3)  in  Appendix  D.  As  we  see  from  (74)  and  (67) 
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(75) 


E{(w+e)2l  E(A2-1A3)2y 

E  {z2}  E  S{0){l-aa/b) 

where 

(A2+A3)2  (b+a) 

A4  =  S^~ (b^Qal 


(76) 


We  note  that  the  quantities  A^,  A2  and  A^  are  essentially  indepen¬ 
dent  of  the  system.  Furthermore,  the  final  result  is  useful  only  if  u>  is  so 
small  that  a<<T  <<  tt/u)  .  In  this  case.  A,  <<A,,  b  —  T  and  A.  is 
close  to  unity. 

From  (75),  (68),  (60),  and  (D-4)  it  follows  that 

3 _ 

j  py(y»  -  G<J£-)|  <  A,  T2  +  1,  03  /  a7 |  (77> 

Choosing  T  so  as  to  minimize  the  above,  we  finally  obtain 


From  the  preceding  discussion  it  follows  that  if  the  input  to  a 
band-limited  system  is  an  a-dependent  process  such  that 

E  £  |x  l3  }  <  *  and  S{0)  i  0 

then  the  resulting  output  tends  to  Gaussianity  with  ua  0  . 
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Appendix  A 

A  useful  lemma,  Given  an  even  non-negative  function  r(x)’o£  unit  area 


f  r(x 


(x)  dx  =  1  ,  r(-x)  -  r(x)  ,  r(x)  >  0 


(A-l) 


and  a  differentiable  function  cp  (x)  such  that 


cp  (±  00  )  =  0  ,  cf>  '(x)  >  -  A  <  0 


(A- 2) 


we  form  the  convolution  integral 


g(x)  =  J  co  (?)  r(x-  %)  dC=  cp(x)  *  r  (x) 


(A- 3) 


We  maintain  that  if 


I  g(x)|  <  B 


(A- 4) 


then  [  9, 11, 12] 


|  cd(x)  |  <  2  A  v 


(A- 5) 


where  v  is  such  that 


j  r(x)dx=-|+^ 


(A- 6) 


Proof.  Suppose  that  the  maximum  of  cp(x)  equals  C  .  Without  loss  of  gener¬ 
ality  we  can  assume  that  this  maximum  is  reached  at  x  =  0.  Thus 


1  co  (x)  J  <  1  co  (0)  1  =  C 


(A- 7) 


Consider  first  the  case  cp  (0 }  >  0  .  Clearly, 


cp  (x)  -  C  =  !  co '  (§)  d  s 


vmmtE  ‘JHig^pwif  a  nr* 


Hence, 


cp  (x)  >  C  -  Ax  (A- 8) 

Furthermore, 

i 

0  2x  » 

g(x)  =  J  +  J  fr  J  cp{§)  r(x-§)  d  5 

-•  0  2x 

From  (A- 8)  and  the  evenness  of  r(x)  it  follows  with  x  -  f  =  y  that 
2x  2x  x 

J  <*>(§)  r(x-§)  d?>  J  (C-A?)  r (x- 5 )  d?  =  2  [C-Ax]  J*  r(y)  dy 
0  0  0 

But 


0  CO 

(t  t‘ 

r  0  ®  -i 

n  n 

x  -i 

J  +  j  cp(?)  r(x-?)d?<C 

J  +  J  r  (x-  % )  d§ 

=  C 

1-2  Jr(y)  dy  1 

■“  ?.x 

2x 

0  J 

Hence, 


x 

g(x)  >  [  4C-2Ax]  J  r(y)  dy  -  C 
0 


Letting 


x 


_C_ 

2A 


in  (A- 9)  we  conclude  with  (A- 4)  that 
C/2A 

B  >  3C  J  r(y)  dy  -  C 
0 


If  our  assertion  {A- 5)  is  not  true  then 
cp  (0)  =  C  >  2  A  y 


(A- 9) 


(A- 10) 


(A*  11) 
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But  this  leads  to  a  contradiction  because  then  (A-10)  would  yield  [see  (A-6)] 
Y 

B>  3  C  J  r  (y)  dy  =  ^  >  B 
0 

hence,  (A-4)  is  true. 

The  case  cp  (0)  <  0  can  be  reduced  to  the  above.  Indeed,  with 
cp  ^ (x)  =  -  cp  (-x),  gj{x)  =  cpj(x)  *  r  (x) 

we  have 

cpj7  (x)  =  co#  (-x)  gj(x)  =  g(-x) 

hence, 

l  ®P  t(x)  1  <  4. 1  (0)  >  0  ,  |  gx(x)  |  <  B 

From  the  above  it  follows  that  |  cp^(x)  |  <  2A  y  and  the  proof  of  the  theorem 
is  thus  complete. 

Corollary.  Consider  two  distribution  functions  F^(x),  F^fx)  and  a  function 
r(x)  satisfying  (A-l).  With 

g(x)  =  [  FjM  -  F2(x)]  *  r(x)  (A- 12) 

we  maintain  that  if 

F2/(x)<.A  (A-13) 

and 

lg(x)|<B  (A- 14) 

then 

|  F^x)  -  F2(x)|<  2  A  y  (A-15) 
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where  V  is  as  in  (A- 6). 

Proof.  With 

cp{x)  =  Fj(x)  -  F2(x) 

we  have  cp{±°°)  =  0  .  Furthermore, 

cp  (x)  >  C  -  Ax 

as  we  see  from  (A-13)  and  the  monotonicity  of  Fj(x).  The  desired  bound 
(A-15)  follows  as  in  the  lemma. 


Appendix  B 

Consider  a  random  variable  x  such  that 


E  {x}  =  0  ,  E  {x2}=  02,  E  {  l  x  |3}  =  c 


(B-l) 


Fith  f(x)  its  density  function  and 


$  (id)  =  J  f(x)  e^U)x  dx 


(B-2) 


the  corresponding  characteristic  function,  we  maint \in  that  for  all  U) 


|  $  ( 0)  )  -  1  J  < 


(B-3) 


nw-i-4^  ±4 


(B-4) 


$  (uu)  =  e 


5c  i  i3 
~~2  +  ®  "21  '  W  * 


for  |  U)  I  <  ~ 


(B-5) 
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As  it  is  known  [2,  13] 

e^tUx  =  l  +  ju)x+0,  , 

J  12 


2  2 
(1)  x 


!  ®  !  I  <  1 


+934^.  |e2l<l 


Inserting  into  (B-2)  we  obtain  (B-3)  and  (B-4). 
From  the  expansion 


2  3 

■log  (1-z)  =  Z  +  ~  +  -y-  +  •  ♦  • 


|  Z  |  <1 


it  follows  with  z  =  1  -  ?  (<u)  tK  t  if  1 1  -  $  (id)  |  <  1  ,  then 

CD 

-log  {1-  [!-$(<*>)]  3=  f  1  -  f  (tu)  ]  +  Y  ^[1-  M«J)]n 


n=2 


hence. 


log  *  (0))  +  -j  u>2  a2 


$  (ill)  -  1  - 


2  2 


id  a 


CO 

+ y  - 

L,  n 

1  -  $  (tu) 

n=2 


n 


As  it  is  known,  0  <  c  ;  hence,  for 


I  1  -  f  (UJ)  i  < 
Therefore, 


2  2 
id  o 


r<i 


(B-6) 


(B-7) 


(B-8) 


(B-9) 


(B-10) 


22 


2  Sin(wT/2) 


cjT 


/ 

/ 

/ 

k-^KS - 


r 


K 


&  ' 


l 


| 

? 


lit 


-CD 


(*  A  V  „ 

j  h(t)  h(t)  dt  =  -^  Jh(U))H  (uu)  dU)=^r  j  1  H (n>) | 2  d»  (C-5) 


-U) 


hence. 


ou 


Ee=  J  [h(t)-h  (t)]2  dt  =  i  J  lH(u»i2[l--g-S^jy-T/2)]  d 


U) 


U) 


But 


|  sin  x  -  x  J  < 


~T 


hence 


,z  p  o 


“*  |HW|2<*»<  §  T2 


(JU 


-(1) 


Appendix  D 

The  r.v.  x  is  such  that  E {x} =  0  ,  E  [x2}  =  1  .  With  F(x)  its 
distribution  function,  w  assume  that  [see  (7)] 
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|  F(x)  -  G(x)  |  <  5  for  all  x 

The  r.v.  y  is  such  that 

E  {  y  }  =  0  E  ^  l  Z  i  3  =  ^  EtxZ3  = 

We  form  the  sum 

*  =  *  +  I 

With  F  (z)  the  distribution  function  of  z  we  shall  show  that: 


(D-l) 


(D-2) 


a)  If  the  r.  v.  x  and  y  are  independent,  then 

|  F  (z)  -  G(z)  |  <  6+  -2-- 
2 


(D-3) 


b)  In  any  case. 


|  F  (z)  -  G(z)  |  <  6+  1.03  VO 
z 


(D-4) 


Proof,  a)  With  fy(y)  the  density  of  y,  it  follows  from  the  independence 
of  x  and  y  that 


Fz(z)  =  J  F(z-|)  f  (5)  d  § 


(D-5) 


hence. 


F  (z)  -  G(z)  =  J  [  F(z-§)  -  G(z-?)  +  G(z-§  )  -  G(z)  ]  f  («•)  d?  (D-6) 


But 


|  G(z-?)  -  G(z)  |  =  1  G'  (z-0  §)  %  1  < 

.v/2tT 


therefore. 


|  F  (z)  -  G(z)  I  <  6  +  J  U|fv(5)dS  =  6  + 

2  JTrt  y  ^2tt 


(D-7) 


and  (D-3)  follows  because  <  0. 

b)  Fz(z)  equals  the  probability  masses  in  the  region  x  +  y  <  z  of  the  x-y 

plane.  With  S  a  constant  to  be  soon  determined,  we  see  that 

F(z-e)  -  p  [y>5 }  <  Fz(z)  <F(z+e)  +  P  <-  e  3  (D-8) 
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i. _  r  m_ ill 

ueutC)  j_  oco  \-^  ■*■/ j 


G{z-e)  -  6  -  P  {jr>e] -  G(z)  <Fz(z)  -  G(z)  <G(z+e)  +  6+  P  {y<-e}  -  G(z) 


and  [  see  (D-7)] 


|  F  (z)  -  G(z)  |  <  6  +  +  P  U  y  'l  >  e  } 

z  72TT 

It  remains  to  select  e  so  as  to  minimize  the  above  bound.  From 
Tchebycheff '  s  inequality  we  have  [9,  p.  150] 

P(lxl>e]  <  ^2 
e 

hence. 


(D-9) 


1  F  (z)  -  G(z)  |  <  §+  — :  +  T 
2  Jl TT  6 


(D-10) 


This  quantity  is  minimum  for 


e  =  .  2  0  -y2TT 


Inserting  into  (D-10)  we  obtain  (D-4). 


If  the  variance  of  x  is  not  one  but  0  ,  then 


F(x)  -  G 


U-) 

V<Iv  ' 


<  6  + 


8  tto 


(D-ll) 


This  follows  readily  from  (D-4)  by  a  simple  scaling. 


3 
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